DOCOBEIT EEStJBE 



ED 123 258 



TH 005 317 



AUTHOB 
TITLE 

P3B DATE 
HOTE 



AVAlLABLr! FSOfl 



Ellison, Jane L*; Sbersan^ Thomas H* 
Systematic Process ;for Evaluating the ^ 
Individualization of Instruction* 
^[Apr 76], ^ 
1*lp*; P&per presented at ,the. Anivual Meeting of, the 
American Educational Researcli Association <60th,. San 
Francifeco, California, April 19-23, 1976) 
^t^Oftas Hr"Sheraan, Collegg^f E^catio a, Ti r gljixH ' 



^DT!S P?ICE 
DESCRIPTORS 



Polytechid. Institute and Stajte University, 
Blacksburg, Virginia ;2tt06 1 tfull text, administration 
manual, and evaluation instrument) 

IJF-$*0<83 -ac*$1.67 Plus Postage. 
Classroom Observation Techniques; Elementary 
S^coiidary* EduCatiop; ^^Evaluation ; Evaluttt ion, Methods; 
^Indiridualized Instruction; ^individualized Programs; 
I^istructional Design; *(lodels'; program Development; 
Program Evaluation; Student Needs; Systems ^Approach; 
-Te'st Reliatrility , , ^ 

A model for evaluating, the ^extent to which 
instruction is.^indivldualized is describe^/. The model is based on a 
conceptualization of ^individualization vhi^h focuses on observable 
teacher behavior resulting in the mahi|»ulation of classro9m 
environmental and^instructlonal variables to meet tHe needs of 
individual learners^ FQr evaluation purposes inidividualization ^s 
consfdered an attrifeute .o^ instruction. An evaluation iiistruiaent was 
deveioped and field te^t^3* This indicated that .teachers and^others 
can employ the mbdel'r'eiiably. The model appears to be valid ani} have 
heuristic iralue; Several implications for the. use of the model are 
discussed, (Author) ' \ * 



ABSTS^CT^ 



— ^ - . ' ' . . 1 ■ 

♦ , Documents acquired by ERIC include many informal unpublished * 

♦ materials not available from other sourcest ERIC makes every effort ♦ 

♦ to obtain the best copy available, nevertheless, items of marginal ♦ 

♦ reproaucibility are often encountered and this affects the quality ♦ 

♦ of the microfiche and hardcopy reproductions ERIC makes available * 

♦ via the EPIC Document Reproduction Service (EDBS) :eD3S is not , - * 

♦ responsible for the quality of the original document* Reproductions ♦ 

♦ sul>plied by BDES are the best that can be made from the original* * 



00 

in 

CM 



A- Systematic Process for 
Evaluating the Individualization 
' of Instruction 



By , 



*US OEP*«TMEMT OF HEALTH 

mAtiomalimstituteo^ 

EDUCATION 

iKiS DOCOJy^EN^ HAS SEEN ''EP^O' 
OUCED ExVcTLV *i PECE^VED F«»OM 

SlAlEOOONOr NECESS**l'i; "^.t^^^ 
iENT Off^'^'.^^^'O'**^ iNSr.l^^lEOP 



CO 



^ Thomas M. Sherman' 
College of Education ' 
Virginia Polytechnic institute 
, aRd State University 
Slacksburg, Virgil 

and * 



Jane El lis6n 
Contracting Corporation of' 
1405' Curtis Street 
Suite V702 
Denver, Colorado 80202 




lerica 



ERIC 



Oiscus-sion of individualized instruction ofteh r^esults 1n what Frase (1972) 
called "a concatenated assemblege of pedagogical phrases" (p. 45). This seems to 
have occurred because there is such a variety of beliefs and opinions about what 
constitute individualized instruction. For example* PSI, Project PLAN and IPJ 
are portrayed as individualized instructional approaches. Yet each differs from 
.the others both in the Quality and the nature of instrujction. The confusion about 
individuaHized instruction is further com0ounde5 by the carrent "fad" Status of 
individualization. That ISj if a teacher* publisher* or other educator wishes to 
'get anywhere in the world of education* the tag '^individualized" is manditory* or 
■no one wi'll pay any. attention. Little matter whether the label, is appropriate 
sance the confusion is^O great that one could prob^ly'f Injl support in the educa- 
tion literature to justify almost any use of the term. 

This confusion has created two related problems. Firsts *there is a need for 

> . 

a clear tonceptualization of exactly what individualized instruction is and what " 
it means to the classroom teacher. Second, practitioners (teacher, principals*^ 
and adtn\nistrators) need a procedure for determining whether or not a program is- 
indeed individualized. To meet these problems an evaluation model has been deve- 
loped which can be applied to instructional programs to detenni.ne the extent to 
which the program is individualized,- The model diff^ from most evaluation m&dels 
in that it focuses on the concept of individualization rathfel* than on" the product(s) 
of the instructional program. As such* the model iSf oriented toward the develop- 
ment artd delivery processes of Instructional programs .in terms of their indivi* 
(itl5fKzed nature. Such a model, can serve several purposes forioth developers and 
-^valuators. For example* a developer can use the model as a guide to systematically 
individualize instruction in a purposeful manner rather. than '^ust choosing common 



individualizing strategies. The model can' also serve a heuristic purpose for 
conceptualizing the purposes and processes involved in individualizing instruction. 
In addition* .program evaluators can use this model to determine if instvuctional 
programs are claYfiloped to meet overall educational goals ^ ^nd purposes. _ ,Fi n al1y> , 
use of this model opens the process of individual i2ati0i>. to tfareful scrutiny and* 
as a reSult* Individualized programs should become more compatible with the wishes, 
pf both adtninistrators and practitioners. It may aUo promote systematic study of 
individualization since the identified .variables can be systematically jnanipulated 
under controlled conditions. ^ ' wJ 

For the purposes of this model* indiv^dualized'instruction js defined as ^ 
process through which var*iable,s in the instrtjctio/ial .milieu are systematically 
manipulated as a function of the needs of individual learners and^the instruc- 
tional objectives. The concept of individualization becomes manageable ^because 
there ar^.a finite number of variables over which the instructor has -conlrt)!. 

r ^ " ^ ***** 

These variables are divided into two classes environmental and instructional 
and are manipulated to accommodate individual student needs and unique differences- 
in order to maximize the probability of learning.. Since tfjg 
variable results in observable change either i^-^£m^^ arrangei] 
instructional procedures* the concept of individualize 



nents 



phenomenoQ. Each variable in both general classes jt^iy, be* art^anged independently 
of every other var'iabl e, therefore individualization -Asz^'^once 
a matter of degree. A program^may have many or all, vaf 
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be 




considered 
rding 



to student needs or only on^ or two. In addition, each variabTe~can be manipulated 
to a greater or lesser extent. Tha extent to which each variable car\. be mSnipuU* 
ted is continuous and can be conceived of as infinite. However* for ^descriptive 



and e.^/aluative purposes a scale organized into a conceptual continuum 0/ manipula- 
tion IS presented. " ■ ' ■ 

^As an instructionaTpT^cess » indi vidual^fation- requires that the instructional 
a nd env ironmental va riabl es be arranged tn a manner to m aximize tti e probab il ity^ of 



each individual leaT^ning what is .intended. The^basic procedure i^^ developing" an 
indivldu^il ized program is the arrangement of these variables. The continuum 
ejcists in terms of: (a) how many variables in each category are manipulated* 
(b) the extent to which each is manipulated, and (c) the quality of the manipula- 
tion. :The first dimension; how many variables are manipulated, is based on the 
total number of variables manipulated and may range from no variables to all 
variables* Since th^re are a total of 13 of these vay^iables, it i.s possible to 
tiave a total of 13 variables manipulated (see Table .1). The second dimension* the 
extent of the manipulation, .is based on ttie notion that manipulation of each variable 
is a mattePSf degree* Since individualization is intended to accoraflodate individual 
needs-; this continuum is. conceptual ized along a- continuuitt of accommodation of 

* * t 

individuals/ For- example, the continuum runs from no manipulation to complete 
arrangement of the varfafHeJip meet individual needs. This had been divided into a 
five point scale which characterizes the extejrt of the manipulation of each variable. 
It IS recognized that complete manipulation of all 13 variables is not only ideal- 
ist.ic but probably unattainable, ^^wever, for the purpose of conceptualization, 
this ideal form of individualization is presented as a goal toward which to strive* 
That is, a teacher should attempt to man^ipulate as many variables as possible to the 
greatest extent,.possible, re^rll2ing it is probably impossible i:o manipulate'all 
vTriabl^s for all students at all times.' ^ * . i 

The" thfi^^imension, th^ qualitTTf^'the manipulation, relates to the information 



used in deciding how the variable will be manipulateti. This- Continuum consists 
of a ran^e from use of no i nformation" to use of an exemplary amount of information 
Decision information is drawn from three majoc sources: empirice^-ddla^ logic "and 
student assessment. This continuum is important since individualization requires 
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considered and reasonable decisions based on sound information. This continuum 
* * * ■ ^ 

is rel^atively compjex and judgemental, but is conceptualized on t^e qualfty of the 

information. The upper^end of the continuum necessarily includes logic, empirical 

research results and assessment data. In addition, the instructor should be ?ble 

to articulate how the data were used in deciding to arrange the variable as observed, 

■ The oth-er end of the contir\uDm involves the use of no data with no articulation 

/ \ ■ 

of why no data-were used. Tlhe .increasingly good'use^of data, as well as an ^ ^ 

increasing ability to articulate the application of this data to pi/aHit^^> defines 

\ 

progress on this continuum. ^ ' ^ . 

In evaluating the individualization of instruction the nonon of individuali- 

zation has-been conceived .of as simi,lar to an attribute-: For examVlVTint^nigenc^ 

may be considered an attribute of an individual. Evaluation of this attribute 

could attemptf to di-sco'^r' how t^iuch of the attribute, was present, what are^ were 

present {e.g. quantitative or verbal); a'nd the quality of the attribute- (e.g^ 

practical or theoretical). With indi;^iduali2ation"^nsidered an attribute ot v ^ 

* ■, ■ * ^ 

instr*uction, the evaluation process determines: (1) how much individualization 

is present, (2) in what ways it is present and (3) the quality of the presence. ^ ^ 

To guide the eyaluation process ^an^ evaluation instrument has been developed; the 

instrument focuses on systematic observation of the^behayiors* of the^educator 

or instructional product, TTse of the instrument-pfwitleS a descriptive picture- 

of the instruction being evaluated in terms of how much indiyi^iualization is 

present. j — ^ ^ ^ ^ ^ 
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Method 

The evaluatioa instrument was field tested with 15 pairs of student teachers 
in^an elementary efluc^tion teacher training^ program. A three haur "training was 
givfn during which the procedures for use of the , evaluation instrument and 
scoring was presented as descri,bed 1n the instruction manual- Classroom, programs^ 
were then evaluated. The manual is 'available upon request. 

* I ' . Results 

, - I The instrument was employed with genet^y htgh reliability; average agreement 
for all pairs was 83^; range was from b2% agreement to 100%. agreement. General 
agreement on some dimensions appeared to be lower than'on others. The dimensions 
, of representational mode and content of objectives appeared to have lower rates 
of agreement than the other .dimensions . 

r 

Conclusions - > \ 

This' evaluation model appears to serve several useful functions. First, it - 
casts the concept of individualization into a reality base. That is, individual- 
^ ization is defined as specific actions taken by teachers to' accommodate individual 
differences. These actions are comprised of manipulations of variable features 

r * 

of the ^instructional mileau. As a result, it is possible to conceptualize individ- 
ualiz^tiyfi^iO a comprehensive manner'as well as to practice individualization. 
* $econd, individualization is conceptualized as a matter of degree. That is> progf'amS 

s . * . 

^ * 

may be either highly individualized or, minimally individualized. Such a notion > 
^ makes possible t^e^planning of a progressively individualized program. And, when 

individualization is-a programatic goal, it is possible to assess the progressive 
I » degiree of individualization developed over time. Such ,<( noti^on should be beneficial 
to both developers and evaluators of instruc^n. Third because of tfje clarity of. 
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the conceptual fzafiori, the model has heuristic value. Once eatjh vay^t^ble Is 
identified and defined, specific\variables can be chosen on which to begin or 
inc/'ease the. level of individualization. This makes the process of individual- 
ization a matter of cpnscious decision making on the part of the developer. 



An additional advantage 0/ this approach is the comprehensive manner in . ^ 
which the process of Individualization is .treated. This ihcludes the manipulation 
of variables to individualize instruction, t>ie degree to wh\ch each ^ manipulated- 
and t;he justification for tjhis action. As a result instruction is not piortrayed , 



as a unidimensional enterprise but ars a complex process requiring qareful and^ 
reasoned development. When using the model for a developmental guide, eacH - 
dimension may be systematically planned for and attended to. Such a procedure ■ ^ 
should result in more accurate and careful instructional development,^ For example, 
as a consequence of using the evaluation model, student tethers became aWare of 
how many ways in which instruction could be individualized. \They also became aware 
of^how each variable could be justified. As a result, these students' teaching 
strategies* more closely approximated^ a rational and systematic approach to in^truc- 
tional, development, . " " 

Several training p^roblems were encountered^-^ The major problem appeared to be 
insuring tbat evafua-tors are. c<Mnpletely familiar with all triie iden,tifi^e(/r^r^ables,^ 
Particular empha^^s' should be given to variables which are not commorrSyf' "Considered 
suefras 'Vepresentational mode" and "content of objectives^'^resentation- of 




multiple examples of these variables rngx^.^^^'^^Suiis problem. Oth^r problems were 



m&inly procedural and irtehided the need for interview techniques to gather just- 
ification information and the need to gain familiarity with, the recording procedures. 
These do not appear to be serious, problems and ean probably be adequately compensated 
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wjth practice under controlled conditions. ' / . . 

The complete text of thfs report is available as well as the administration 
manual and the evalflatlpn instrurpent upon request. Send^requests to: 

' Thomaj; IVL S haman ^ 

College of Education . 

Virginia Polytechnic Institute ' . 

and State University 
Blac^burg, Virginia 24061 ^ , 
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Table 1 

The thirteen identified variables which 
*may be manipulated to individualize 
instruction 



Variable 
1* Representational Mode- 

* 

1. Message Channel 



3, Content of Objectives 



4, Establishment of Objectives 



S: Goals 



6, Strategics . * 



Definition 

The way in which infonuation will 
be represented to the learner; based 
on a continuum from concrete to 
abstract. * * - < 



The means thVough wh^c^ infonfiatfon 
will be- communicated to the learner 
{auditory, visual, tactile, ole-' 
factdT^y; etc.}* 

a. The- familiar notion of conteot 
or* "knowing what" Dr the 
subject matter of the objectives 

b. The mental f)r*oce5s of the 
objective '6r focusing on the 

.^'kndWing how" or level of - 
objectives stfch ^s is done - - 
in .Bloom's Taxonoiry. ^ 

a. Who objectives; that is, 

, the level of student participa- 
*tion fn the objective setting 
process. 

b. How are objectives set; that is, 
on^vfhat basis Sire objectives 
set (i*e. pre-determined 
^according to .an instructional 
program or based strictly on 
student needs). 

Purpose statements which guide the ' 
development of, an instructional 
■program^ , ' 

The actions the teacher takes to 
implement the instructional process. 



iO 



Assessment- 



s: 

9. 
ID. 



Evaluation 

Remediation 

Time 



'11, Space 



12, Grouping 



13. Resources 



The process of gathering decision 
(naking information in order to 
determine" how variable; features 
of the instructional mileau should 
be manipulated. 

CoUeting information relative tft 



s 



studejit achievement of objective^. 

Providing studerrtj with expferi§hces 
appropriate for correcting errors. , ; 

a. Time allowed for compl etion* of 
objectives. , ^ 

b. Time allowed for instruction". 

a. ' Th£ design of J^e physical area 

designated for learning . 

^ * \ '-^ 

b. ^ The design of the physical areas V 

'for activities not associated 
with classroom learning (e.g* 
playround, cafeteria), 

The^ way in which learners are * 
grouped for, instruction 
and other activities... 

a. Textual r^printedj. sot/nd or visual 
^ learning materials whiCh^are an 
intricate part of the^ learning 
program. ^ - ' 

Worksheets:* materials prepared to 
provide for student responses 

* * - 

c. Human: individuals available ta 
support and facilitate the, 
success of the instructional 
program. 

d. Other resources: this includes 
machinery like film'projectors, 
tape recorders, overhead projec^rs 
etc . 
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